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•  Systematic  method  for  validation  necessary 

-  Modeling  and  Simulation 

-  Laboratory  test 

-  Validation  of  designs 

•  Reduce  need  for  Subject  Matter  Experts 

•  Reduce  number  of  field  tests 

•  Assess  cost  of  validation  and  certification 

•  Use  existing  data  mines  of  tests,  M&S,  and  designs 
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•  Model  validation  under  uncertainty 

-  Uncertainty  in  field  data 

-  Uncertainty  in  model  data 

-  Validation  of  designs 

•  Multiple,  incompatible  data  channels  can  be  evaluated 

•  Interval-based  method  provide  more  robust  evaluation 
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Reduced  CAE  results 
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Comparison  of  Model  and  Test 
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Course  1 

First  principal  component,  62%  total  variability  captured 
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Course  1 

First  2  principal  components,  86%  total  variability 
captured 
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>  sample  statistics:  d  =  mean( d)  < 
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Multivariate  hypothesis  test:  Assuming  prior  d  ~  A/(M.Z) 
H0:|p|  <  e  (accept)  versus  Ha:|p|  >  e  (reject) 


Bayesian  factor  calculation 
Bm=  P(d|H0)  /  P(d|Ha)  (likelihood  ratio) 


BF  confidence  quantification 
K  =  P/W  /  (  ^  +P/w)  X  ^ 
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•  Bayesian  framework  promising  for  validation 

-  Incorporates  statistics  of  field  data 

-  Incorporates  statistics  of  M&S 

-  Enables  systematic  evaluation  of  data  variability 

•  Systematic  method  for  accepting  M&S 

•  Systematic  method  for  comparing  M&S 

•  Further  refinement  needed  for  calibration  and  sensitivity 

•  Further  research  required  for  accreditation  use 
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